Position Title: Senior AWS DevOps & Data Engineer
Location: McKinney, TX
F2F: Yes
Hybrid: Yes
Job type: 12+ Months contract
santosh@ebusinesstechcorp.com
About the Role:
We are seeking a highly skilled Senior AWS DevOps & Data Engineer to join our team. This role requires a unique blend of DevOps expertise with a strong background in data engineering and cloud development. You will play a pivotal role in designing, implementing, and optimizing infrastructure and data pipelines on AWS to support scalable, secure, and efficient workflows.
Key Responsibilities:
DevOps & Cloud Architecture:
- Develop and maintain AWS infrastructure using Cloud Development Kit (CDK) and CloudFormation.
- Architect and implement CI/CD pipelines for efficient application and data pipeline deployment.
- Manage IAM roles and permissions, API Gateways, SQS, SNS, and load balancers to ensure robust and secure operations.
Data Engineering & Development:
- Build and optimize scalable ETL/ELT pipelines using tools like Airflow DAGs.
- Develop data transformation and processing frameworks in Python and SQL, including advanced SQL techniques like window functions.
- Collaborate with data teams to integrate and manage data in AWS-based data lakes and Redshift.
Cross-Functional Collaboration:
- Work closely with software developers, analysts, and business stakeholders to deliver data-driven solutions.
- Design reusable frameworks and libraries that improve team productivity and standardize best practices.
Performance & Optimization:
- Monitor and improve system performance, scalability, and cost efficiency.
- Troubleshoot and resolve issues in AWS environments related to CI/CD, APIs, and data workflows.
Required Qualifications:
- 5+ years of experience in AWS cloud architecture, with a focus on DevOps and data engineering.
- Proficiency in AWS CDK, CloudFormation, and building CI/CD pipelines.
- Strong programming skills in Python and expertise in SQL, including window functions.
- Experience with data pipeline tools (e.g., Airflow, Glue) and working with Redshift or similar cloud data warehouses.
- Deep understanding of IAM roles and policies, API Gateway, SQS, SNS, and load balancers.
- Proven track record of designing scalable and reusable frameworks for DevOps and data engineering.
